DOCUMENT RESUME 



ED 419 830 



TM 028 405 



AUTHOR 

TITLE 

INSTITUTION 

PUB DATE 
NOTE 
PUB TYPE 
EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Lyons, Andri; Smith, Ralph 

Super I: 1996-97 Pilot Program Year-End Report. Publication 
Number 96.07. 

Austin Independent School District, TX . Dept, of 
Accountability, Student Services, and Research. 

1997-10-00 

18p . 

Reports - Evaluative (142) 

MF01/PC01 Plus Postage. 

Behavior Problems; Expulsion; High School Students; 
Intermediate Grades; Middle Schools; *Nontraditional 
Education; Out of School Youth; Pilot Projects; Program 
Evaluation; Secondary Education; ^Substance Abuse; Urban 
Schools 

* Austin Independent School District TX; Middle School 
Students 



ABSTRACT 



The Substance Use Prevention Education and Resources (SUPER 
I) program of the Austin Independent School District (Texas) is a 
school-based middle- and high-school curriculum that is offered as a positive 
alternative to long-term removals to students who have committed alcohol or 
drug-related offenses for the first time (excluding the sale or distribution 
of controlled substances) . SUPER I was begun in the middle schools and 
expanded to all 10 high schools in the spring of 1996-97. In 1996-97, of 
1,502 students removed from classes for alcohol or drug-related problems, 224 
elected to enter SUPER I, and 176 completed the program. The majority of 
program staff rated the program as effective in deterring student use of 
illegal substances and in improving family communications. Recommendations 
are made for continuing the program, especially tracking students to 
determine long-term effectiveness of SUPER I. Increased promotion of SUPER I 
to campus staff as a positive alternative to long-term removal is also 
recommended. It is also suggested that the program continue to support a team 
approach to session presentations. (Contains 10 figures.) ( SLD) 
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Overview 



SUPER I (.Substance Use 
prevention Education and 
Resources) is a school-based, 
middle- and high-school 
curriculum which is offered as 
a positive alternative to long- 
term removals to students who 
have committed alcohol or 
drug-related offenses for the 
first time (excluding offenses 
involving the sale or 
distribution of controlled 
substances). SUPER I was 
begun as a pilot program in 
AISD middle schools in the fall 
semester, and was expanded to 
include all 10 high schools in 
the spring semester. The 
programmatic goals of SUPER 
I are stopping short- and long- 
term substance abuse among 
the targeted population; 
improving family 
communication skills; and. 
promoting family involvement 
in support sen ices. 

Budget 

bunding Sources: 

Federal & Private 
(Motorola. Inc. /Pathways) 

bunding Amount: 

$10,820 (Motorola) 
$24,043 (Federal) 



Major Findings 

1. In 1996-97. 459 of the 
1.502 (30.5%) removed to 
the ALC were admitted for 
reasons related to alcohol or 
drug use (AOD) or 
possession. Of this number. 
224 elected to enter the 
SUPER I program, and 176 
completed the program. 

2. Although high school 
students were not admitted 
to the SUPER 1 program 
until the spring semester, 
nearly as many (106) 
participated in the program 
as middle school students 
(118) who were eligible to 
participate the entire year. 

3. SUPER I participants were 
more likely to have used 
cigarettes, beer, liquor, and 
marijuana recently and more 
often than secondary 
students in general. 

4. Of the 176 w ho completed 
the program. 29 later 
returned to the ALC. but 
only three ( 1 .7%) were 
referred for subsequent 
AOD offenses. 

5. The majority of program 
staff rated the program as 
effective in deterring student 
use of illegal substances and 
in improving family 
communications. 



Recommendations 

1 . Continue tracking of first- 
year program students to 
assess long-term effec- 
tiveness of SUPER 1. 

2. Edit and update materials 
to reflect problems and 
conditions associated 
with area communities 
and schools. 

3. Make better use of trans- 
ition facilitators by 
clarifying their roles and 
responsibilities. 

4. Strengthen the 
promotion of SUPER 1 
as a positive alternative 
to long-term removal to 
campus staff. 

5. Improve efforts to 
gather follow -up 
information from 
SUPER 1 families and 
students on long-term 
program effectiveness. 

6. The program should 
continue to support a 
team approach to 
session presentations. 
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Introduction 



Program Overview 

SUPER I (Substance Use Prevention A'ducation and Resources) is a school-based, middle- 
and high-school curriculum which is offered as a positive alternative to long-term removals to 
students who have committed alcohol or drug-related offenses for the first time (excluding offenses 
involving the sale or distribution of controlled substances). The SUPER I program was developed 
bv the Metropolitan Atlanta Council on Alcohol and Drugs (MACAD) With corporate assistance 
from Motorola. Inc. and in partnership with Pathways Community Counseling. SUPER 1 was 
begun as a pilot program in A1SD middle schools in the fall semester, and was expanded to include 
all 10 high schools in the spring semester. The main programmatic goals of SUPER 1 are: 

• Stopping short- and long-term substance abuse among the targeted population: 

• Improving family communication skills: and. 

• Promoting family involvement in support services. 

The primary incentive for participation is an abbreviated term of two weeks, rather than 
the standard six weeks, at the district's Alternative Learning Center (ALC). If the student and his 
or her parents (or other significant adult) completed the voluntary, eight-hour, four-session 
program, the remainder of the student’s removal w as served on an in-school basis, thereby keeping 
the voung person in school under superv ision and preventing the student from falling further behind 
m his studies. For the purposes of the pilot program, all students" referral histories to the ALC 
prior to the 1996-97 school year, including any referrals for drug- or alcohol-related reasons, were 
ignored, and all students referred to the ALC were considered first-time offenders in the pilot year. 

Funding 

Motorola. Inc the corporate sponsor, prov ided support for travel, initial training, and one 
set of program materials. In addition. Motorola supported one training cycle per month in the fall 
semester, and two cycles in the spring semester, through Pathways: all additional cycles were 
funded through the Title IV Safe and Drug-Free Schools and Communities (SDFSC) grant. The 
Motorola/Pathvvav s partnership expended a total of $10,820 for their portion of the SUPER I 
project. For the 1996-97 school year. $62. 190 was budgeted from the SDFSC grant. Of this sum. 
$24,043 had been spent through July 3 1 . Funds from both sources were used primarily for start-up 
and operations, including: 

• purchasing SUPER I materials from MACAD: 

• stipends for training the facilitators: 

• extra-dutv pav for facilitators (the sessions were presented in after-school, evening 
sessions): 

• program planning and consultation. 

Pcr-studcnt/family cost for the program is calculated below However. it should be noted 
that this figure includes initial start-up costs (e g., materials acquisition, training, and travel), in 
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addition to annual program operating costs. It can be expected that per-family cost will be lower in 
subsequent years of the program. Program costs are summarized in Figure 1 below. 



Figure 1 


: SUPER I Funding Summary 


Budget Source 


Amount 1 


Motc>roIa<''Pafl)vsm < s 


:!l| ; $io.82o 


y. C 


24.043 


"Petal Program itedgg|i|| 


$34,863 




lyyiy $34,863/224 = $ 155.63 



In addition, the district also provided Spanish-language translations of program materials 
to better serve some SUPER I families. The district agreed to provide the translated materials to 
MACAD for an in-kind exchange of additional materials, including booklets and videotapes, and 
future typesetting and provision of Spanish-language materials. 



Evaluation Scope and Method 

The evaluation focused on the impact of the SUPER I program in reducing student 
repeaters to the ALC. A database of all referred students was established and maintained as the 
basis for longitudinal study. In the first year, students from three cycles were selected for tracking 
purposes. 

Students in all SUPER I cycles for three separate months were administered OPE's 
Student Alcohol and Other Drug Use Survey (SAG DUS), an instrument which asks secondary 
students to report on recent and long-term substance use and attitudes toward use. Participants 
were asked to complete the survey immediately prior to their first SUPER I session. Two scales, 
the Parent-Adolescent Communication Survey and the Family Satisfaction Survey . developed at 
the University of Minnesota's Center for Family Social Research, were employed as measures to 
assess the effectiveness of SUPER I in improving family communications skills. These two 
instruments were intended to be repeated three months after completion of SUPER I as post- 
program measures; however, the return rate for these surveys was unacceptably low. so no 
comparisons could be made to determine program gains with these instruments. 

SUPER I program facilitators, co-facilitators, and police officers also completed 
evaluation forms at the conclusion of each cycle, enabling program staff to determine which 
students/families did or did not complete the cycle. In addition to the above measures, surveys of 
key program staff, including ALC staff, home campus transition facilitators, and principals were 
also conducted to gather a more complete picture of the effectiveness of the SUPER I program. 
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Students and Families Served 

Of the 1.502 students removed to the district’s Alternative Learning Center in 1996-97. 
459 (30.5%) were admitted for reasons related to alcohol or illegal substances, including simple 
possession of alcohol or drugs (AOD). or for being under the influence of these substances. 
(Students committing AOD offenses formed the second largest group of referrals to ALC. only 
behind those students referred for persistent misbehavior.) Of this number. 224 students entered 
the SUPER 1 program. Because high school students who committed AOD offenses were not 
eligible to participate in SUPER 1 until the spring semester, there was a disparity between the total 
number of high school students referred to the ALC for AOD offenses and the number of students 
entering SUPER 1 

Figure 2. shown on the following page, summarizes demographic and academic 
performance characteristics of the secondary students served by SUPER I. The analysis by the 
Office of Program Evaluation’s GENESYS ( GEN cric Evaluation .ST. Stem ) reveals several 
important distinctions between the student population served by SUPER I and the regular A1SD 
secondary population: 

Attendance rates in both semesters for middlc/junior high school SUPER I students were 
markedly lower than for nonprogram students, and were slightly lower for SUPER I high school 
students, compared to their nonprogram peers. SUPER I students at both secondary levels do not 
fare as well in the classroom as nonprogram students. Grade averages for both middle/junior high 
and high school students in the program were lower by eight to eleven percentage points in both the 
fall and spring semesters than grade averages for nonprogram students. 

A majority (57%) of middle school referrals were from low-income families: only 30% of 
high school referrals were from low -income families. A substantial proportion of program students 
were overage for grade by at least one year (39% MS/JHS. 41% HS). Twenty-five percent ot 
middlc/junior high school referrals and 16% of high school referrals were special education 
students. 
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Figure 2: Characteristics of SUPER I Students. 1996-97 



Student 

Characteristics 


Middle School/ 
Junior High School 


High School 




81% Male 


81% Male 




1 9% Female 


1 9% Female 


Ethnicity 


18% Afr. Am. 


12% Afr. Am. 




| 57% Hispanic 


42% Hispanic 




) 25% Other 


46% Other 


Low ■lllllll 


57% 


30% 


tnamtelllllf 


39% 


41% 


I.FP 


| 5% 


1% 


Special V Y;- ' V 1 


25% 


16% 


Education 
GiftecV | 


3% 


4% 


Talented . . . :||| 

Average Number of Fs ■ 


2.48 (Fall) 


2.19 (Fall) 




2.57 (Spring) 


2.39 (Spring) 


Grade 


SUPER I 


All MS 


SUPER I 


All HS 


•ijAverage 


73.1 (F) 


83.5 (F) 


70.9(F) 


78.8 (F) 




72.6 (S) 


83.4 (S) 


67.2 (S) 


78.9 (S) 


Avera^p;. fllliilllil 


SUPER 1 


All MS 


SUPER I 


All HS 


Attendance | 


85% (F)* 94.6% (F) 


88.2% (F) 


90.4% (F) 




81% (S)* 92.3% (S) 


| 82.5% (S) 87.8% (S) 



Source: AISD Student Master Files 
*(Note: F=Fall. S=Spring) 
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Figure 3 summarizes the number of students and families served by the program at the 
high school and middle/junior high school level, according to whether or not they completed the 
SUPER 1 program. 

Figure 3: 1996-97 SUPER I Participation. Completers vs. Non-Completers 



Student 

Partieinants 


Middle 

School 


% of 
Total 


High 

School 


%of 

Total 


Total 


%of 

Total 


Non* ! 


87 


39.01% 


89 


39.73% 


176 


78.57% 


Hrfs! 


31 


13.83% 


17 


7.59% 


48 


21.43% 




118 


52.67% 


106 


47.32% 


224 


100% 



Source: 1996-97 Alternative Learning Center Year-Knd Report 



Of the 224 students w ho participated in SUPER E slightly more than halt were from junior 
high or middle schools ( 1 18. or 52.67%). However, high school students were only admitted to the 
program in the spring semester, yet the number of referrals from high schools (106. or 47.32%) 
was nearly equal to that from junior high/middle schools for both the tall and spring semesters. 
Overall, approximately 79% of all students who enrolled in SUPER I completed the two-week 
program, resulting in abbreviated stay s at the ALC. Because it is a condition of the program for 
parents (or other adults) to attend all sessions, students may have failed to complete all four 
sessions due to adult absence. However, the percentage of students failing to complete the cy cle 
for this reason is unknown. The percentages of students from high schools and middlc/junior high 
schools forming the completers group were nearly equal (high schools = 50.85%. middle/junior 
high schools = 49.14%): however, middle school students formed a large majority of the 
noncompleters group (middle/junior high schools — 65% vs. high school = o5%). 

Figure 4 summarizes the levels of adult participation for 341 SUPER I sessions for which 
attendance data were available. Of these sessions, students' mothers attended 262 (77%) sessions, 
and fathers attended 101 sessions (30%). However, only 56 (16%) of the sessions were attended 
by both parents. Sessions in which an older sibling, guardian, or other significant adult attended 
with the student constituted 13% of the total sessions. 



Figure 4: SUPER I Family Participation Levels. 1996-97 * 



Familv Attendance Data 


# of Sessions 


Number of sessions wtth the mother attending. 


262 


Number of sessions theM^ sSsaKlihg: l|i\ 


101 




56 


sNumliei^ 


10 


Number of sessions with a guardian attending: 


16 


filter of:sessloas : ^b.mEt "other aM$' attea&ag: ' : 

rlotafhtimfcof^ IIHIIIBI 


20 


(4 sessions per cveie X # students) y;;;;. : jv 


34 1 
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Student Substance Use Self-Report 

Students entering all cycles of SUPER I in three separate months were asked to voluntarily 
complete the Student Alcohol and Other Drug Use Survey (SAODUS). an instrument which is 
used in the district to assess levels of use and attitudes of students toward use of alcohol and other 
drugs. Students w ere assured of anonvTmtv and confidentiality. Results of these survey items w ere 
compared to identical items on the Student Substance Use and Safety Survey (a more recent 
version of the SAODUS). which was administered to secondary campuses districtvvidc in the 
spring. Figures 4 through 7 contrast self-reported use of cigarettes, beer, liquor, and marijuana 
between SUPER I students and a random sample of all A1SD secondary students. Comparisons 
should be made with caution due to differences in sample size, survey conditions, and general 
population differences between the two groups. Keeping this caveat in mind, the survey data 
suggest: 

• A much smaller proportion of SUPER 1 students reported that they do not use 
cigarettes (47%) compared to the overall student population (74%). A much higher 
proportion of SUPER I students appear to be heavy smokers (27% reported smoking 
20+ times in the previous month) compared to all secondary’ students (8%). (See 
Figure 5.) 

• SUPER I students also reported drinking beer more frequently in the past month than 
secondary students overall, and a smaller proportion (58%) said they did not drink 
beer than in the overall student population (72%). Only small percentages (SUPER 
1=4%. overall population=3%) of each group reported heavy beer drinking (20+ times) 
in the previous month. (See Figure 6.) 

• Usage pattern differences for liquor between the two groups are similar to beer- 
consumption patterns, but slightly higher percentages of both groups reported thev did 
not use liquor (SUPER 1=61%. overall population=76%). SUPER 1 students were 
more than twice as likely to have consumed liquor in the previous month (28%) than 
secondary students overall (13%). Percentages of students in both groups reporting 
heavy use was low (0%-2%). (See Figure 7.) 

• Perhaps the most pronounced difference in the two groups was in their self-reported 
recent use of marijuana. Though 78% of secondary students ov erall reported not using 
mari juana, only 45% of the SUPER 1 students reported the same. Furthermore, nearly 
twice the percentage (15%) of SUPER 1 students reported using marijuana 
occasionally (one or two times in the previous month) as secondary students (8%). 

The greatest contrast was among those reporting relatively heavy usage rates (11-19 
times). Thirty-four percent (34%) of SUPER 1 students reported this rate of usage in 
contrast to only 2% of the overall student population. (See Figure 8.) 
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Figure 5: Self-Reported 30-Day Use of Cigarettes, 
SUPER 1 vs. All A1SD Secondary Students, 1996-97 




HSUPIiR I 
□ All Secondary 



Figure 6: Self-Reported 30- Day Use of Beer, 
SUPER I vs. All AISD Secondary Students, 1996-97 
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Figure 7: Self-Reported 30-Day Use of Liquor, 
SUPER 1 vs. All AISD Secondary Students, 1996-97 
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□ All Secondary 



Figure 8: Self-Reported 30-Day Use of Marijuana, 
SUPER I vs. All AISD Secondary Students, 1996-97 
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Measures and Perceptions of Program Effectiveness 

Figure 9 shows the level of ALC ''repeaters" among SUPER I referrals; i.c.. those students 
who were removed to the ALC more than one time in the 1996-97 school year. The numbers 
below the row labeled "Repeaters (All)" includes SUPER 1 participants who were enrolled at the 
ALC more than once in the 1996-97 school year for ah reasons, including alcohol and drug-related 
offenses. Overall, there was a total of 29 return referrals among SUPER I completers, yielding a 
return rate of 16.5% among the completers. However, only three students among the program 
completers returned to the ALC for alcohol or drmi-rclatcd (AOD) reasons, yielding a recidivism 
rate of 1.7% for the completers . Overall, a total of six students, completers and noncompleters 
alike, were returned to the ALC for AOD-relatcd reasons for an overall recidivism rate of 2.7% for 
all participants. No SUPER 1 participants returned to the ALC for AOD-relatcd reasons more 
than once. For purposes of comparison, the total repeat enrollment rate at the ALC in 1996-97 
was 12.38%. 



Figure 9: ALC Repeaters Among SUPER I Participants. 1996-97 
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Source: 1 996-97 Alternative Learning Center Year-End Report 



SUPER I program facilitators, co-facilitators, and AISD police officers were asked to 
estimate the effectiv eness of SUPER I in achiev ing two of the primary goals of the program. 1) 
Deterring student alcohol and drug use. and 2) Improving family communications. Figure 9 
summarizes program personnel's perceptions of the effectiveness of SUPER I in achieving its 
primary goals of deterring student use of drugs and alcohol and in improving family 
communication skills, based on surveys completed at the end of each of .vO cycles. While most 
respondents rated SUPER I favorably ov erall, their responses tended to favor the program's impact 
on family communications (95% rated it as "Somewhat Effective" or "Very Effective") over its 
effectiveness in deterring student use of drugs and alcohol (69% of responses rated it as 
"Somewhat Effectiv e" or "Very Effective" in this area). Figure 10 summarizes their responses. 
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Figure 10: SUPER 1 Staff Perceptions of Program Effectiveness 
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(*One facilitator stated that SUPER I was effective lor those w hose drug use was minor, but less effective lor those 
who use drugs and alcohol regularly. ) 

Source: A1S1) Department of Accountability. Student Services, and Research SUPER I Facilitator Surveys 



The facilitators, co-facilitators, and police officers were also given space on the survey 
forms for additional comments. These comments followed several major themes: 

• The most common suggestions for improv ing the program were to update the materials 
and to include data and statistics pertinent to Austin and Texas, and to require both 
parents to attend all sessions if both live in the home. 

• Activities and program materials required more than the time allotted. 

• SUPER 1 is seen as a positive first step in getting parents and students to communicate 
about problems at home and at school. 

• 92% of facilitators and co-facilitators stated a preference for a team approach to 
program presentation. The majority of the respondents stated that they shared 
responsibilities for facilitation of activities equally 

• 24% of facilitators (including co-facilitators and police officers) reported utilizing their 
own materials in their presentations, including pencils, refreshments, knowledge, and 
personal experiences. 
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• Practice makes perfect. Staff scheduling and materials availability became 
increasingly efficient during the course of the first year. 



A survey was also mailed to the principals of the 25 secondary campuses in the district 
Surveys were returned from three middlc/junior high schools and from four high schools. The 
principals were asked to agree or disagree with, and comment on. the statement. "The SUPER 1 
program for students with first-time drug and alcohol offenses had a generally positive effect on 
students' behavior following their completion of the program.” Responses to this statement were 
mixed. Two responses indicated agreement with the statement, two disagreed, and one disagreed 
strongly. Two offered no opinion. Those agreeing with the statement did so without comment. 
Comments from those in disagreement included an opinion that the program w as too short to effect 
any lasting, meaningful change. The only suggestions tor modify ing and improving the program 
was that of offering the program at the campuses to more closely tailor the program to the needs of 
the students at that campus. 

A similar survey was also mailed to the ALC transition facilitators at the 25 secondary 
campuses. Thirteen surveys (52%) were returned. Of the thirteen responses, six (46%) agreed or 
strongly agreed that SUPER 1 had had a positive effect on students behaviors, two disagreed 
(15%). and five (39%) offered no opinion. Additional comments and suggestions from the 
transition coordinators included: 

• Anecdotal reports of improved behavior after the student returns to his or her home 
campus. 

• Some believe that some students continue to offend once they are returned to their 
home campus, but are more carefi.il not to be apprehended. 

• A number of the facilitators expressed the opinion that the real strength of SUPER 1 
lies in its ability to reestablish communications within families, and in helping parents 
confront their childrens' substance use and other school -related problems. 



Conclusions, Recommendations, and Next Steps 

The SUPER 1 program has demonstrated considerable success in its first y ear of operation. 
As with manv pilot programs, there were some inconsistencies and unanticipated problems in the 
early stages, but the staff and steering committee were able to devise solutions as they arose. 
Several recommendations for program improvement arose during the course of the first year, 
among them: 

• Strong support for continuing a team approach (facihtator/co-facilitator) to session 
presentation; 

• Editing and updating of program materials to reflect problems and conditions 
particularly associated with Austin and central Texas communities and schools; 

• Greater promotion to principals and other campus personnel of SUPER 1 as a positive 
alternative to long-term removal; 

• Making better use of the home campus transition facilitators by clarify ing their roles 
and responsibilities in the program; 
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• Exploring the possibilities for establishing SUPER I-likc programs at the campus- 
level; and. 

• Improving efforts to gather follow-up information from SUPER 1 families and students 
on long-term program effectiveness. 

Plans arc being made to continue tracking of the pilot program students for repeat offenses 
(AOD and other) as a measure of the long-term effectiveness of the program, as well as tracking 
students who enter the program as first-time offenders in its second year. In the second year, the 
evaluation will endeavor to include long-term follow-up measures on the progress of students and 
their families. 
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